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I. 


INTRODUCTION 


The  purpose  of  this  report  is  to  provide  a means  by  which  the 
parameters  of  the  Generalized  Rayleigh  Distribution  can  be  estimated 
from  experimental  data. 


The  Generalized  Rayleigh  Distribution  can  be  expressed  as 


Il/2(n-2) 


(1) 


where ± 


R > 0, 


= + X*  + . . . + X2  , 

i l.  n 


/is  a random  normal  vector  distributed  in  n dimensions. 


v.  V 

rk*\ 
A1 


is  tL:  mean  vector. 


V V 


! Jk\  + A2  + 


. . + An  , 


M is  a positive  definite  covariance  matrix  = I \|r  where  is 
n r n o o 

a positive  constant  and  1 is  the  identity  matrix, 

I is  the  modified  Bessel  function  of  the  first  kind  of  order  v. 
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The  derivation  of  the  probability  density  function  in  Equation  (1) 
is  given  by  Miller'*'. 

II.  BACKGROUND 

Special  cases  of  the  Generalized  Rayleigh  Distribution  appear 
in  many  physical  environments  in  electrical  engineering,  radar  engineer- 
ing, and  sene  areas  of  optics. 

This  report  is  an  outgrowth  of  research  in  the  area  of  laser  radar 
technology.  However,  the  results  should  be  of  general  interest  and  find 
application  in  other  disciplines  where  the  Generalized  Rayleigh  Distri- 
bution is  encountered. 

If  n,  the  number  of  dimensions,  in  Equation  (1)  is  set  equal  to  2 
then  the  probability  density  function  can  be  expressed  as 


p<R>  • it) " (•  (“)  • u> 

2 

This  distribution  is  sometimes  called  the  Rician  Distribution  . 
Radar  engineers  will  recognize  it  as  the  output  of  an  IF  amplifier  when 
the  input  is  Gaussian  noise  and  a sinusoidal  signal  of  constant 
amplitude. 


If  A is  allowed  to  approach  zero  in  Equation  (2)  then  it  can  be 
shown  that  Iq  is  approximately  1 and  the  probability  density 

function  can  be  expressed  as 


This  is  the  well-known  Rayleigh  Distribution.  To  radar  engineers 
it  is  the  familiar  output  of  an  IF  amplifier  when  the  input  is  Gaussian 
noise. 

In  many  practical  situations  it  becomes  necessary  to  have  the  capa- 
bility to  estimate  the  two  parameters  (A,  \|<  ) of  Equation  (2)  from 

experimental  data.  This  was  the  problem  that  had  to  be  addressed  during 
the  research  in  Laser  Radar  Technology. 


^Miller,  K.  S.,  Multivariate  Distributions,  Robert  E.  Krieger 
Publishing  Company,  Inc,,  New  York,  1974. 

2Ibid. 
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The  remainder  of  this  report  presents  the  development  of  the 
methodology  to  estimate  the  two  parameters  and  an  analysis  of  the  per- 
formance of  the  estimation  technique  in  a simulated  environment. 

III.  METHODOLOGY 

Some  of  the  more  common  statistical  techniques  employed  to 
estimate  the  parameters  of  a known  distribution  are: 

a)  Maximum  likelihood  estimators. 

b)  Method  of  moments. 

c)  Method  of  quantiles. - 

d)  Minimum  variance. 

Each  of  these  methods  was  explored  and  analytical  and  practical 
problems  were  encountered  in  all  four  methods. 

Applying  the  technique  of  maximum  likelihood  requires  the  determina- 
tion of  the  log-likelihood  function  of  a sample  drawn  from  the  distri- 
bution. Given  a sample  of  size  n drawn  from  the  population  whose  dis- 
tribution function  is  p(R;  A,  \)/o)  the  likelihood  function  is 

MR,,,  Rn;  A,  i|r0)  = pn(R1 Rn;  A,  tQ) 

~ p(R^>  A,  p(R£;  A,  ^),,,«  ,p(R^ ; A,  ) 
n 

= U p(Ri5  A,  *D)  . (4) 

i=l 


The  log  of  the  likelihood  function  is  usually  easier  to  work  with 
and  is 


In 

JP  P^;  A,  \|rQ) 
i=l 


(5) 


The  estimates  of  and  A are  determined  by  solving  the  following 
simultaneous  equations 


(6) 
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The  problem  with  this  approach  is  the  difficulty  in  taking  the 
partial  derivative  of  the  log  of  a Bessel  function. 

The  moments  of  the  Generalised  Rayleigh  Distribution  proved  diffi- 
cult to  work  with.  The  expressions  for  the  first  two  population  moments 
are  (for  n = 2) 


(7) 


where  P(x)  is  the  gamma  function  and  jF^  is  the  confluent  hypergeometric 
function. 


The  first  moment  can  also  be  expressed  in  terms  of  Bessel  functions. 
That  is. 


These  population  moments  are  equated  to  the  sample  moments  and  the 
resulting  system  of  equations  is  solved  for  the  parameter  estimates. 

These  equations  could  be  solved  only  through  some  approximation  procedure. 

Quantile  estimators  require  that  the  probability  density  function 
be  integrated  to  yield  the  cumulative  density  function.  The  integral 
of  Equation  (3)  can  not  be  easily  evaulated  and  a numerical  or  series 
approximation  is  needed. 

3 

Linear  estimators  have  been  developed  but  this  technique  (at 
least  the  one  reveiwed  by  this  author)  requires  that  t be  a known 
constant. 

Due  to  the  computational  complexity  of  the  assumptions  involved  the 
previous  methods  were  eliminated  from  consideration  as  viable  candidates. 

Normally,  in  a situation  such  as  this  where  the  distribution  is  of 
a form  that  does  not  yield  simple  estimators,  an  alternative  approach 
is  to  attempt  to  apply  some  simple  transformation  which  results  in  a 
simplification  of  the  estimation  process. 


^Miller,  loc  cit. 
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A transformation  of  the  distribution  in  Equation  (2)  yields  a 
distribution  form  for  which  simple  parameter  estimates  can  be  found  and 
which  characterizes  a device  known  to  the  radar  engineer.  The  trans- 
formation is 


X = R 


(9) 


The  result  is  the  same  as  passing  the  output  of  the  IF  amplifier 
through  a square  law  detection  device. 

Applying  the  transformation  to  the  probability  density  function  in 
Equation  (2)  yields  the  following  density  function: 


p(X)  = 


/jl\  EXP  j .ql±.£A  1 

v2v  \ 2i0  i Vo)  ' 


(10) 


1 A 

Letting  p = 1,  a = ~ — , and  p results  in 


2i<  ’ ““  K * 

o o 


P0O  - o'"1  EXP  | - ^ j 


EXP  (-OX)  I 


,-t  (*/*) 


(ID 


which  is  the  Bessel  Distribution  as  defined  by  Laha  . 

This  form  of  the  density  function  allows  one  to  develop  moment 

2 

estimators  for  the  parameters  (A'  and  ^Q)  of  the  Generalized  Rayleigh 
Distribution. 

The  moment  estimators  can  be  developed  from  the  characteristic 
function  given  by  Laha  . 


n 

. „2  1 

EXP' 

It-fT  . 1 

l1  ' «) 

4a2  (1  - it/a)  ] 

(12) 


The  moments  of  the  distribution  are  found  by  taking  the  derivative 
of  <t>  (t)  with  respect  to  t.  The  first  four  moments  are 


\aha,  R.  0.,  "On  Some  Properties  of  the  Bessel  Function  Distri 
butions,"  Bull-Calcutta  Mathematical  Society,  Vol.  16,  p.  59-71. 

~*Ibid. 
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d * (t)/dt  ft2 

h +“ 


d2$  (t)/dt2  .4  2 

nl(X)  =*  = JL-  + ft  ,(P  + 1)  , El2_±  1) 

2 i2  16a4  2a3  a2 

d3<t>  (t)/dt^  .6  4 , 2 2 

n' (X)  = — = -S—  |ft  ■ .(3,g+  6)  + ft  (3p  + 9P  + 6> 

i 6^a6  16a5  4a4 


(13) 


+ iP3  + 3p2  + 2p ) 

a3 

n' (X)  - fc  = —ftf  + ftlfe.  + 3)  + ft4 C 3p 2 + 15p  + 18) 

i4  256a8  16a7  8a6 

+ ft2(P3  + 6p2  + lip  + 6)  (P4  + 6p3  + Up2  + 6p ) 

5 u 

a or 

The  complete  derivation  of  these  moments  is  shown  in  Appendix  A. 
Letting  P " 1.  « * 2*“  , and  p - ~ yields: 


(il  (X)  - A2  + 2f 
1 o 


ni(X)  « A4  + 8*  A2  + 8*  2 
^ o o 


n' (X)  = Av  + 18 * Ah  + 72*  2A2  + 484 

J o o i 


(14) 


Ma(X)  = A8  + 32 A6  + 288t  2A4  + 7684  3A2  + 384*  4 
^ ° o o o 

The  first  two  central  moments  are: 


MX(X)  - nJ(X)  = A^  + 2to 

2 


U2(X)  = nJ(X) 


- M 


2 2 
44  A + 4* 
o o 


(15) 
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Estimators  for  the  two  parameters  can  be  found  by  equating  the 
e lations  for  the  population  moments  in  Equation  (15)  to  the  sample 

2 

moments  and  solving  the  two  equations  for  \|f  and  A . The  sample 
estimates  are 


(16) 


where  M^(X)  and  {^(X)  are  the  two  sample  moments, 
sample  mean  and  ^(X)  is  the  sample  variance. 
quantity;  therefore,  the  sign  of  the  radical  in  A^ 


i.e.,  Mt(X) 
cannot  b*  a 
is  positive. 


is  the 
negative 


IV.  PROPERTIES  OF  THE  ESTIMATORS 

In  most  statistical  analyses  it  is  desirable  to  know  something 
about  the  properties  of  the  different  estimators  so  that  some  logical 
choice  can  be  made  between  competing  estimators.  Although  only  one  set 
of  estimators  has  been  developed  it  is  still  desirable  to  investigate 
some  of  the  more  common  optimality  properties  of  the  estimators. 

A 

An  analytic  investigation  of  the  properties  of  A and  \| / was  not 

performed  because  the  approaches  necessary  to  such  an  investigation 
proved  to  be  analytically  intractable.  However,  an  empirical  analysis 
of  some  of  the  properties  was  performed  by  simulating  sample  data  from 
the  Generalized  Rayleigh  Distribution. 

The  first  property  investigated  was  that  of  consistency.  An 
estimator  is  said  to  be  consistent  if: 

a)  The  expected  value  of  the  estimator  approaches  the  true  value 
of  the  parameter  as  the  sample  size  increases. 

b)  The  dispersion  (variance)  of  the  estimator  decreases  as  the 
sample  size  increases. 

The  following  simulation  runs  were  made  va-ying  the  parameters 
and  the  sample  size.  Seven  samples  for  each  set  of  conditions  were  run 
by  varying  the  seed  number  for  the  random  number  generator. 
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A2:  2.0,  5.0,  10.0,  17.0,  26.0 

V 1-° 

r : 25,  50,  75,  100,  200,  300,  400,  500,  750,  1000. 

The  results  of  the  analysis  are  shown  in  Appendix  B.  An  examination 
of  the  results  indicates  that  the  estimators  appear  to  be  consistent. 

^2 

Figures  1 and  2 show  a plot  of  the  expected  value  of  A and  standard  error 
~2 

of  A , respectively,  for  one  case. 


A second  property  that  is  desirable  for  an  estimator  to  possess  is 
unbiasedness.  For  an  estimator  to  be  unbiased  its  expected  (average) 
value  must  equal  the  true  parameter  value.  Consistency  implies 
asymptotic  (n  => «)  unbiasedness  but  it  does  not  imply  unbiasedness  for 
any  specific  sample  size.  One  cannot  conclude  from  the  simulation  data 
in  Appendix  B that  the  estimators  are  unbiased  for  any  sample  size; 
however,  it  can  be  concluded  that  the  bias  is  relatively  sm'^ll  for 
sample  sizes  greater  than  75.  A more  accurate  estimate  of  the  true 
bias  could  be  obtained  by  generating  more  than  7 samples  with  which  to 
calculate  the  expected  value. 


V.  PERFORMANCE  OF  THE  ESTIMATORS 

To  determine  how  well  the  parameter  estimators  A and  \)q 

perform  in  a practical  situation  a number  of  random  samples  from 
Generalized  Rayleigh  Distributions  were  generated  with  various  parameter 
values.  From  these  samples  the  estimators  were  calculated  and  a chi- 
square  goodness-of-fit  test  was  performed  to  determine  if  the  sample 
data  were  really  drawn  from  a Generalized  Rayleigh  Distribution.  The 
rationale  behind  this  approach  is  that  since  the  distribution  is  known 
to  be  the  Generalized  Rayleigh  then  the  parameter  estimators  should 
lead  to  an  acceptance  of  the  hypothesis  of  the  chi-square  test  if  they 
adequately  estimate  the  true  parameters. 

The  only  problem  with  this  approach  is  that  the  distribution 
parameters  used  in  the  test  must  be  either  known  or  estimated  by  the 
maximum  likelihood  method.  Since  the  method  of  moments  was  used  to 
estimate  the  parameters,  the  chi-square  test  is  not  strictly  applicable. 
This  problem  arises  quite  often  in  practice  where  the  usual  procedure 
is  to  use  the  chi-square  test  and  to  hope  that  any  error  introduced 
is  small. 

Twenty-one  different  cases  were  examined  using  a 1000-sample  data 
points.  The  results  of  the  chi-square  test  are  shown  in  Table  1. 
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STANDARD  DEVIATION  OF  A' 


400  600 

SAMPLE  SIZE 


/%2 

Figure  1.  Expected  value  of  A versus  sample  size. 
Average  of  7 samples. 


200  400  600  800 

SAMPLE  SIZE 

Figure  2.  Standard  deviation  of  A versus  sample  size 
taken  from  7 samples. 


TABLE  1.  RESULTS  OF  CHI-SQUARE  GOODNESS -OF-FIT  TESTS. 
SAMPLE  SIZE  = 1000,  CELLS  = 25. 


True  Parameter 
Values 

Estimated  Parameter 
Values 

Critical 
Cc  Level 

A2 

A2 

A 

K 

A 

a 

0.0 

0.5 

0.28 

0.  35 

0.76 

0.0 

1.0 

0.55 

0.69 

0.76 

0.0 

2.0 

1.12 

1.39 

0.76 

1.0 

0.5 

1.12 

0.43 

0.62 

1.0 

1.0 

1.33 

0.81 

0.02 

1.0 

2.0 

1.85 

1.52 

0.66 

2.0 

0.5 

2.10 

0.46 

0.53 

2.0 

1.0 

2.24 

0.90 

0.37 

2.0 

2.0 

2.61 

1.70 

0.37 

5.0 

0.5 

5.10 

0.46 

0.42 

5.0 

1.0 

5.20 

0.91 

0.78 

5.0 

2.0 

5.47 

1.77 

0.52 

10.0 

0.5 

10.10 

0.47 

0.57 

10.0 

1.0 

10.18 

0.92 

0.39 

10.0 

2.0 

10.39 

1.81 

0.48 

17.0 

0.5 

17.09 

0.47 

0.25 

17.0 

1 

17.17 

0.93 

0.06 

17.0 

2.0 

17.35 

1.83 

0.02 

26.0 

0.5 

26.09 

0„47 

0.50 

26.0 

1.0 

26.16 

0.93 

0.23 

26.0 

2.0 

26.32 

1.84 

0.55 

i in 


To  apply  the  chi-square  tests  that  were  used  requires  that  the 
sample  data  be  divided  into  equiprobable  frequency  cells.  The  » umber 
of  cells  in  this  analysis  was  25. 

The  larger  the  critical  a level  in  Table  1, the  better  the  fit; 
i.e.,  the  hypothesis  that  the  data  are  from  a Generalised  Rayleigh  Dis- 

^2  A 

tribution  with  parameters  A and  is  more  likely  to  be  accepted. 

A common  a level  is  0.05  or  0.10.  As  can  be  seen  there  are  three  cases 
where  the  Q level  was  below  0.10.  For  these  cases  the  hypothesis  must 
be  rejected. 

A better  fit  for  the  data  in  these  three  cases  could  possibly  be 
obtained  by  a slight  shift  in  some  of  the  cell  limits  since  the  cells 
containing  abnormally  high  and  low  frequency  counts  were  adjacent  to 
one  another.  The  difference  in  some  of  the  data  points  in  the  adjacent 
cells  was  ii.  the  second  and  third  decimal  places. 

VI.  CONCLUSIONS 

It  Is  believed  that  the  parameter  estimators  developed  in 
this  report  provide  a simple,  viable  means  by  which  the  parameters  of 
the  Generalizeu  Rayleigh  Distribution  can  be  estimated.  Furthermore, 
from  the  empirical  study  it  would  appear  that  the  estimators  offer 
consistent  and  relatively  unbiased  estimates  of  the  true  parameters. 

The  practical  value  of  the  estimators  is  realized  with  the  ease  with 
which  the  necessary  calculations  can  be  made. 
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Appendix  A. 

DERIVATION  OF  THE  MOMENTS  FOR  THE  BESSEL  DISTRIBUTION 


The  probability  density  function  of  the  Bessel  variate  is  given  by 


Laha  as: 


P(X)  = OP-1  EXP  j^J  EXP  J-°X  J 1^  (&/x)  . 

The  associated  characteristic  function  is  given  as: 

* (t)  =(l  - — ) P EXP  -}  * 

x ' a'  (4c/(l  - it /a)  j 

The  jth  factorial  moment  of  the  distribution  can  be  found  by 


(A-l) 


(A-2) 


..•oo  = 


-J(X)  = 


4>  (t)/dt^ 


dj  (1  - it/Q)"P  EXP 


m a - J.t/a) 


(A-3) 


(A-4) 


Letting  w = l - — 


y - L 

4a2 (1  - it/o) 
then  for  j = 1 

d 4>  (t)  , -p  y 

xv  d w e 


-p  de^  y dw  P 

” 7T  + e ~ 


-p  y dy  , y.  -p-1 , dw 
= w e + e^(-pw  ) tt 


Laha,  loc,  cit. 


Preceding  page  blank 


■ »-p  1 (&  - P"-1  g) 


0 

* *-(t)  (g  - P""1  dl) 


= ♦ (t) 


ip: 


. P(-i/Q) 


x \4C^(1  - it/a)2  (l  - it/a) 
The  first  moment  is 


^<X) 


/ 

is 


+ — PlZSL 


\ 2 L 

- it/a)  (1  - it/a) 


) 


J t=0 


(A-5) 


ui(!i)’^+a 

For  j * 2 one  finds 


d 4>  (t)  d (d<t>  (t)/dt) 

X X 


dt 


dt 


dV‘)  7J 


ip /a 


4a  (1  - it/a)  (1  - it/a) 
dt 


Letting  z » z^  + 


ill 


ip/Q 


4q2 (1  - it/a)2  (l  - it/a) 


then 


d <t’x^  d0x^t)z 


dt 


dt 


* (t)  • 
X c 


\(t)  5 


0 (t) 
X 


V‘> 


I6a^(l  - it/a)4  2aJ(l  - it/a)J  a‘(l  - it/a) 


Th«:  second  moment  is 


* ♦ (t)  d (t)a 

X X 


, da  adVt> 

' \(t>  M*~7T~ 

Now  d4»x(tVdt  has  been  shown  to  be 


d%(t> , » (t)  _ — i i-—  + — ieis- 

dt  x I 4a2 (l  - it/a)2  (l  - it/a) 

which  we  previously  defined  to  be 


= <t>  (t)  z 
x 


4>x(t)  + ^2) 


Therefore 


d3<j>  (t) 

~3  * *x(t>  dT  + *\(t)  <*1  + zl) 

at 


= yt)  £ + a («1  + *2) 


da,  da2  da3 

"dt"  + IT  + "dT  + alzl  + alz2  + a2Zl  + a2Z2 


+ a3zL  + a3z2 


► (t)  g+  5 ' * 

x 64a  (1  - it/a)  16a  (l  - it/a) 


, 3„2,„  2 


.3,3  . -2 


+ 1 •'Y  * : =x : — zjlu 

4a4(l  - it/a)4  a3(l  - it/a)3 
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♦,(t>  £ + b vt)(zi + *2> 


* Vt)|f+b<Zl  + Z2>} 

(db  db  db  db 

~ *x(t)  |"dt~  + *dt~  + "dt~  + It  + blzl  + blz2  + b2Zl  + b2Z2  + b3Zl 

+ b3z2  + Vl  + b4z2 1 


V‘> 


.8 


i4g8 


4 6 

_+  13  (PH-  3) 

8 J ,,  7 


256a  (l  - it/a)  16a' (l  - it/a) 


+ iV(3p2  + 15p  + 18)  + iW  + 6p2  + lip  + 6) 
sa6(i  - it/a)6  a5(i  - it/a)5 


4 4 3 2 

. A (p  + 6p  + lip  + 6p) 

4 4 

a (i  - it/a) 


^00  - 


4 4 

d ^x(t)/dt4 


t=0 


ft8  + P6(p  + 3)  + &4(3p2  + 15p  + 18) 
256a8  16a7  8a6 


+ 3 (P^  + 6p2  + lip  + 6)  (p4  + 6p3  + lip2  + 6p) 


a 


a 


TABLE  B-l.  (Continued). 


True 

Parameter 

Values 


10.0  1.0 


17.0  1.0 


26.0  1.0 


Sample 

Size 


200 

300 

400 

500 

750 

1000 

25 

50 

75 

100 

200 

300 

400 

500 

750 

1000 

25 

50 

75 

100 

200 

300 

400 

500 

750 

1000 


Parameter 

Estimates 

A2 

Standard 

Standard 

Hear 

Deviation 

Mean 

Deviation 

9.93 

10.08 

10.0 

10.0 

10.01 

10.05 

18.02 

18.12 

17.67 

17.61 

16.89 

17.11 

17.02 

17.00 

17.1 

17.04 
26.82 
27.33 

26.85 
26.69 

25.86 
26.13 

26.03 

26.01 

26.12 

26.05 
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